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(54) Display control by means of fingerprint recognition and tracking 



(57) In an information device 1 0, a fingerprint image 
capture section 20 captures a fingerprint image of an 
operator. When a fingerprint image captured by the fin- 
gerprint image capture section 20 is referred to as a first 
fingerprint image and a fingerprint image captured at a 
given time interval after the first fingerprint image is cap- 
tured is referred to as a second fingerprint image, a com- 
parison section 30 compares minutiae points of the first 
and second fingerprint images extracted by a minutiae 
point extraction section 60. An image generation section 
40 generates image information which is changed while 
reflecting the comparison results of the comparison sec- 
tion 30. A display section 50 displays an image based 
on the image information generated by the image gen- 
eration section 40. The information device 10 may be 
provided with a check section 1 1 0, and display control 
by the display section 50 may be performed after a fin- 
gerprint image is checked by the check section 110. 
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Description 

BACKGROUND OF THE INVENTION 

5 [0001] The present invention relates to an Information device and a display control method. 

[0002] In information devices including a display section, various types of control (operations) are performed by 
designating a position on a menu screen or moving a pointer on a screen. The information device may be controlled 
by specifying coordinates on a panel having conductors disposed in the shape of a matrix by using an input indicator 
having a tuning circuit, for example (see Japanese Patent Application Laid-open No. 7-134630). In this case, current 

10 is caused to flow through two arbitrary conductors in the X direction or Y direction disposed in the shape of a matrix, 
and a position designated on the panel is specified by a voltage generated by magnetic coupling between the tuning 
circuit inside the input indicator and the conductors. The information device is controlled by using the position specified 
as instruction information. 

[0003] Accompanied by progress of integration technology and mounting technology and the like, portable informa- 
15 tion equipment (information device in a broad sense) such as an IC card, a personal digital assistant (hereinafter 
abbreviated as PDA), a personal computer, and a portable telephone has been used. Since portability is important for 
such information equipment, reduction of the size and weight of the information equipment and reduction of power 
consumption are necessary. 

[0004] However, it is difficult to drive information equipment using the input device disclosed in Japanese Patent 
20 Application Laid-open No. 7-134630 for a long period of time by using a battery. Moreover, since the input indicator 
must be used, it is difficult to reduce the size and weight of the information equipment. Therefore, it is difficult to mount 
the input device disclosed in Japanese Patent Application Laid-open No. 7-1 34630 on portable information equipment. 
[0005] Accompanied by development of the information-oriented society, personal information has been handled in 
the portable information equipment. Therefore, the necessity for security protection of the portable information equip- 
25 ment has increased. Therefore, it is desirable to increase the degree of security protection by preventing the portable 
information equipment from being controlled by a person other than the verified person. 

BRIEF SUMMARY OF THE INVENTION 

30 [0006] In view of the above-described technical problems, the present invention may provide an information device 
capable of controlling the display of a display section with high accuracy by using a simple configuration and a display 
control method. 

[0007] The present invention may also provide an information device capable of controlling the display of a display 
section while increasing the degree of security protection and a display control method. 
35 [0008] According to one aspect of the present invention there is provided an information device comprising: 

a fingerprint image capture section which captures a fingerprint image; 

a comparison section which compares a first fingerprint image captured by the fingerprint image capture section 
with a second fingerprint image captured by the fingerprint image capture section at a given time interval after the 
40 first fingerprint image is captured; 

an image generation section which generates an image based on the comparison result of the comparison section; 
and 

a display section which displays the image generated by the image generation section. 

45 [0009] In this information device, the first fingerprint image captured by the fingerprint image capture section is com- 
pared with the second fingerprint image captured by the fingerprint image capture section at a given time interval after 
the first fingerprint image is captured, and an image which is changed based on the comparison result is displayed in 
the display section. Therefore, in the case where the first and second fingerprint images are fingerprint images of 
different persons, the image can be prevented from being changed. This prevents occurrence of malfunction in the case 

50 where something other than a finger is captured as the image, whereby display control of the image can be performed 
just as the operator intended. Moreover, leakage of information due to operation by a person whose first and second 
fingerprint images cannot be associated with each other can be prevented. In this information device, since it is un- 
necessary to separately provide a scrolling device or a. pointing device, reduction of the size of the information device 
and an increase in the size of the display section can be achieved. In particular, in the case where the information 

55 device is applied to a highly functional card type information device such as an IC card or a smart card, reduction of 
space can be realized. 

[0010] The information device may comprise: 
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a minutiae point extraction section which extracts minutiae points of the first and second fingerprint images, where- 
in: 

the comparison section compares positions of the minutiae points of the first and second fingerprint images; 
5 and 

the image generation section uses a moving directions, a moving distance, and a rotational angle between 
corresponding two minutiae points of the first and second fingerprint images and generates an image. 

[0011] In this information device, minutiae points of fingerprint images are extracted and an image is changed by 
10 using the extracted minutiae points. Therefore, the amount of information which should be compared in the comparison 
processing of fingerprint images is significantly decreased, whereby the processing load can be reduced. This also 
contributes to reduction of the size of the information device. 
[0012] The information device may comprise: 

*5 a check section which checks the first fingerprint image with registration information which has been previously 

registered, 

wherein the comparison section compares the first fingerprint image with the second fingerprint image when the 
check section has determined that the first fingerprint image is identical with the registration information. 

20 [0013] In this information device, the captured first fingerprint image is checked with the registration information. If 
it is determined that the first fingerprint image is identical with the registration information, the display image is changed 
by comparing the first fingerprint image with the second fingerprint image. Therefore, the information device can be 
applied to a credit card or a cash card for which a high degree of security protection is required. Moreover, since the 
fingerprint image can be checked by strictly examining the fingerprint image, it is unnecessary to strictly compare the 

25 first fingerprint image with the second fingerprint image (number of coincidence points may be about 50% of that in 
the check processing, for example). This enables comparison processing to be simplified even if the processing load 
is necessary to follow the movement of the fingerprint image in the check processing, whereby an information device 
capable of controlling display with high accuracy without increasing the processing load can be provided while main- 
taining a high degree of security protection. 

30 [001 4] In the information device, the check section may determine whether or notthe first fingerprint image is identical 
with the registration information based on a minutiae point of the first fingerprint image. 

[0015] In this information device, since minutiae points of a fingerprint image are used for check, the amount of 
information to be compared in the check of a fingerprint image can be significantly reduced, whereby the processing 
load can be reduced. 
35 [0016] The information device may comprise: 

a minutiae point extraction section which extracts a minutiae point of at least the first fingerprint image; and 

a check section which checks the first fingerprint image with registration information which has been previously 

registered, wherein: 

40 

the comparison section compares the first fingerprint image with the second fingerprint image when the check 
section has determined that the first fingerprint image is identical with the registration information; 
the registration information includes lengths of two line segments and an angle formed by the two line seg- 
ments, the line segments connecting one minutiae point of the fingerprint image with another minutiae point 
45 closest to the minutiae point, and the minutiae point and still another minutiae secondarily closest to the mi- 

nutiae point; and 

the check section checks the first fingerprint image based on: the registration information; lengths of two line 
segments connecting the minutiae point of the first fingerprint image with a minutiae point closest to the mi- 
nutiae point of the first fingerprint image, and the minutiae point of the first fingerprint image and another 
50 minutiae point secondarily closest to the minutiae point of the first fingerprint image; and an angle formed by 

the two line segments drawn from the minutiae point of the first fingerprint. 

[0017] In this information device, information including the lengths of the two line segments which connect the mi- 
nutiae point with the closest minutiae point and the second closest minutiae point and the angle formed by the two line 
55 segments can be associated with each minutiae point. Therefore K the amount of information associated with minutiae 
points of a fingerprint image can be reduced, and the load of check processing by using the information can be signif- 
icantly reduced. 

[0018] The information device may comprise: 
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a minutiae point extraction section which extracts a minutiae point of at least the first fingerprint image; and 

a check section which checks the first fingerprint image with registration information which has been previously 

registered, wherein: 

5 the comparison section compares the first fingerprint image with the second fingerprint image ,when the check 

section has determined that the first fingerprint image is identical with the registration information; 
the registration information includes the number of times a line segment connecting minutiae points of a fin- 
gerprint image intersects a fingerprint ridge or a fingerprint valley of the fingerprint image; and 
the check section checks the first fingerprint based on: the registration information; and the number of times 

10 a line segment connecting minutiae points of the first fingerprint image intersects a fingerprint ridge or a fin- 

gerprint valley of the first fingerprint image. 

[0019] In this information device, for check is used the number of times a line segment connecting minutiae points 
intersects a fingerprint ridge or a fingerprint valley of a fingerprint image. Therefore, the amount of information asso- 
15 ciated with minutiae points of a fingerprint image can be reduced, and the load of check processing by using the 
information can be significantly reduced. 

[0020] In the information device, the minutiae point may include at least one of a ridge bifurcation and a ridge ending 
of a fingerprint. 

[0021] According to this information device, since minutiae points can be extracted from a fingerprint image by or- 
20 dinary image processing, the check processing or comparison processing of fingerprint images can be simplified. 
[0022] In the information device, a frequency in capturing at least the first fingerprint image may be lower than a 
frequency in capturing the second fingerprint image when the fingerprint image capture section periodically captures 
a fingerprint image. 

[0023] In this information device, the capturing frequency (frame frequency) is decreased when capturing the first 
25 fingerprint image, and the capturing frequency is increased when capturing the second fingerprint image. Therefore, 

the frequency can be increased only in the case where a fingerprint image must be captured at high speed in order to 

follow the movement of the fingerprint image, and the frequency can be decreased in the case where a fingerprint 

image must not be captured at high speed. Therefore, unnecessary power consumption can be reduced. 

[0024] In the information device, the fingerprint image capture section may have a detection surface for capturing a 
30 fingerprint image, transition to a high speed mode for operating at a first frequency when a finger is in contact with the 

detection surface, and transition to a low speed mode for operating at a second frequency when a finger is not in 

contact with the detection surface. 

[0025] In this information device, since the fingerprint image capture section transitions to the high speed mode only 
in the case where it is necessary to capture the fingerprint image at high speed, unnecessary power consumption can 
35 be reduced. 

[0026] In the information device, the image generation section may generate an image scrolled based on the com- 
parison result of the comparison section. 

[0027] In the information device, the image generation section may generate an image having a pointer moved based 
on the comparison result of the comparison section. 
40 [0028] According to this information device, reduction of space of the information device which maintains security 
protection can be realized even if the display space is greater than the display region of the display section. 
[0029] According to another aspect of the present invention, there is provided an information device comprising: 

a fingerprint image capture section which captures a fingerprint image; 
4 $ a comparison section which compares a minutiae point of a first fingerprint image captured by the fingerprint image 

capture section with a minutiae point of a second fingerprint image captured by the fingerprint image capture 
section at a given time interval after the first fingerprint image is captured; 

an image generation section which generates an image, the comparison result of the comparison section causing 
the image to be scrolled or a pointer on the image to move; and 
50 a display section which displays the image generated by the image generation section. 

[0030] According to still another aspect of the present invention there is provided an information device comprising: 

a fingerprint image capture section which captures a fingerprint image; and 
5 5 a comparison section which compares a minutiae point of a first fingerprint image captured by the fingerprint image 

capture section with a minutiae point of a second fingerprint image captured by the fingerprint image capture 
section at a given time interval after the first fingerprint image is captured, 
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wherein a function of the information device is controlled based on the comparison result of the comparison 
section. 

[0031] According to further aspect of the present invention, there is provided an information device comprising: 

5 a fingerprint image capture section which captures a fingerprint image; 

a check section which checks registration information which has been previously registered with a first fingerprint 
image captured by the fingerprint image capture section, and 

a comparison section which compares a minutiae point of a first fingerprint image captured by the fingerprint image 
capture section with a minutiae point of a second fingerprint image captured by the fingerprint image capture 
10 section at a given time interval after the first fingerprint image is captured, when the check section has determined 

that the first fingerprint image is identical with the registration information, 

wherein a function of the information device is controlled based on the comparison result of the comparison 
section. 

15 [0032] According to this information device, since the function of the information device can be changed according 
to the change in the minutiae point of the fingerprint image (change in position, for example), operability of multi- 
functional information device can be improved. 

[0033] According to yet another aspect of the present invention there is provided a display control method which 
controls a display section by means of a captured fingerprint image, the display control method comprising: 

20 

capturing a first fingerprint image and then a second f ingerprint image at a given time interval after the capture of 
the first fingerprint image; 

comparing the first and second fingerprint images; and 

changing a display image based on the comparison result of the first and second fingerprint images. 

25 

[0034] The display control method may comprise: 

extracting minutiae points of the first and second fingerprint images; and 

using a moving directions, a moving distance, and a rotational angle between corresponding two minutiae points 
30 of the first and second fingerprint images and changing the display image. 

[0035] The display control method may comprise: 

checking the first fingerprint image with registration information which has been previously registered; and 
35 comparing the first and second fingerprint images when the first fingerprint image has been determined to be 

identical with the registration information. 

[0036] The display control method may comprise determining whether or not the first fingerprint image is identical 
with the registration information based on a minutiae point of the first fingerprint image. 
40 [0037] The display control method may comprise: 

extracting a minutiae point of at least the first fingerprint image; 

checking the first fingerprint image with registration information which has been previously registered; and 
comparing the first fingerprint image with the second fingerprint image when the first fingerprint image has been 
45 determined to be identical with the registration information, wherein: 

the registration information includes lengths of two line segments and an angle formed by the two line seg- 
ments, the line segments connecting one minutiae point of the fingerprint image with another minutiae point 
closest to the minutiae point, and the minutiae point and still another minutiae secondarily closest to the mi- 

50 nutiae point; and 

the first fingerprint is checked based on: the registration information; lengths of two line segments connecting 
the minutiae point of the first fingerprint image with a minutiae point closest to the minutiae point of the first 
fingerprint image, and the minutiae point of the first fingerprint image and another minutiae point secondarily 
closest to the minutiae point of the first fingerprint image; and an angle formed by the two line segments drawn 

55 from the minutiae point of the first fingerprint. 

The display control method may comprise: 
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extracting a minutiae point of at least the first fingerprint image; and 

checking the first fingerprint image with registration information which has been previously registered, wherein: 

the registration information includes the number of times a line segment connecting minutiae points of a 
fingerprint image intersects a fingerprint ridge or a fingerprint valley of the fingerprint image; and 
the first fingerprint image is checked based on: the registration information; and the number of times a 
line segment connecting minutiae points of the first fingerprint image intersects a fingerprint ridge or a 
fingerprint valley of the first fingerprint image. 

[0038] In the display control method, the minutiae point may include at least one of a ridge bifurcation and a ridge 
ending of a fingerprint. 

[0039] In the display control method, a frequency in capturing at least the first fingerprint image may be lower than 

a frequency in capturing the second fingerprint image when a fingerprint image is periodically captured. 

[0040] In the display control method, an operating mode may be transitioned to a high speed mode .for operating at 

a first frequency when a finger is in contact with the detection surface, and may be transitioned to a low speed mode 

for operating at a second frequency when a finger is not in contact with the detection surface. 

[0041] In the display control method, an image scrolled based on the comparison result may be generated. 

[0042] In the display control method, an image having a pointer moved based on the comparison results may be 

generated. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

[0043] FIG. 1 is a block diagram schematically showing a configurational example of an information device. 
[0044] FIG. 2A is a diagram for illustrating a ridge bifurcation which is one of minutiae points of a fingerprint; and 
FIG. 2B is a diagram for illustrating a ridge ending which is also one of minutiae points of a fingerprint. 
[0045] FIG. 3A is a schematic diagram showing scrolling of an image; and FIG. 3B is a schematic diagram showing 
movement of a pointer. 

[0046] FIG. 4 is a block diagram schematically showing a configurational example of an information device which 
verifies an operator. 

[0047] FIG. 5 is a flowchart showing the first half of an operation flow of the information device of FIG. 4. 
[0048] FIG. 6 is a flowchart showing the latter half of the operation flow of the information device. 
[0049] FIG. 7 is a block diagram showing a detailed configurational example of the information device of FIG. 4. 
[0050] FIG. 8 is a diagram showing a configurational example of the fingerprint sensor shown in FIG. 7. 
[0051] FIG. 9 is a cross-sectional view showing a capacitance detection element of the fingerprint sensor. 
[0052] FIG. 1 0 is an equivalent circuit diagram of a capacitance detection element when a dielectric film of the fin- 
gerprint sensor is touched by a ridge of a fingerprint. 

[0053] FIG. 11 is an equivalent circuit diagram of the capacitance detection element when the dielectric film of the 
fingerprint sensor is touched by a valley of a fingerprint. 

[0054] FIG. 12A is a diagram showing arrangement of the capacitance detection elements in the fingerprint sensor; 
and FIG. 12B is a diagram for illustrating a procedure of forming a fingerprint image from ridges and valleys detected 
by the capacitance detection elements. 

[0055] FIG. 13 is a flowchart showing an example of a verification flow of the information device. 

[0056] FIG. 14 is a diagram showing an example of connecting minutiae points of a fingerprint image. 

[0057] FIG. 15A is a diagram showing three line segments provided with a minutiae point as an initial point; FIG. 

15B is a table showing lengths of the three line segments and angles formed by the three line segments associated 

with a minutiae point; and FIG. 15C is a table showing basic information and collected information. 

[0058] FIG. 1 6 is a table showing inner products obtained by two line segments and associated with a minutiae point. 

[0059] FIG. 17A is a diagram showing an example of connecting minutiae points of a fingerprint image; and FIG. 

1 7B is a table showing examples of the ridge information. 

[0060] FIG. 18 is a flowchart showing an example of a display control flow of the information device. . 
[0061] FIG. 19 shows fingerprint images in a frame f and in the next frame (f + 1). 
[0062] FIG. 20 shows an example of a display space and a display region. 
[0063] FIG. 21 shows an example of a display region before scrolling. 
[0064] FIG. 22 shows an example of a display region after scrolling. 

[0065] FIG. 23 is a flowchart showing an example of control processing of a frame frequency of the fingerprint sensor. 
[0066] FIG. 24 is a view showing a finger of an operator to be verified by the fingerprint sensor of the information 
device applied to an IC card. 

[0067] FIG. 25 is a flowchart showing an example of frequency control processing of the fingerprint sensor according 
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to whether or not a finger of an operator is in contact with a detection surface. 

DETAILED DESCRIPTION OF THE EMBODIMENT 

5 [0068] Embodiments of the present invention are described below. Note that the embodiments described hereunder 
do not in any way limit the scope of the invention defined by the claims laid out herein. Note also that all of the elements 
described below should not be taken as essential requirement to the present invention. 

[0069] The embodiments of the present invention are described below in detail with reference to the drawings. 
10 1, Information device 

[0070] FIG. 1 schematically shows a configurational example of an information device. 

[0071] The present embodiment relates to an information device having a personal verification function and an in- 
formation display function. As examples of such an information device, information devices for which security protection 
* 5 is important and include an information display section such as a display, such as a personal computer (PC), a personal 
digital assistant (PDA), an IC card, and a portable telephone, can be given. The information device may be applied to 
an IC card including an integrated circuit (IC) as portable information equipment, for example. The IC card is used as 
various types of cards such as a credit card or a cash card. 

[0072] An information device 10 includes a fingerprint image capture section 20, a comparison section 30, an image 
20 generation section 40, and a display section 50. The information device 10 may further include a minutiae point ex- 
traction section 60. 

[0073] The fingerprint image capture section 20 captures a fingerprint image of an operator (user) of the information 
device 10. The fingerprint image capture section 20 is capable of capturing the fingerprint images at least twice. The 
fingerprint image capture section 20 may be formed to repeatedly capture the fingerprint images at a given frequency, 
25 for example. As the fingerprint image capture section 20, a fingerprint sensor which detects a fingerprint by using 
various methods may be used. The fingerprint sensor is preferably small taking into consideration that the information 
device 10 is applied to the portable information equipment. 

[0074] In the case where a fingerprint image captured by the fingerprint image capture section 20 is referred to as 
a first fingerprint image and a fingerprint image captured at a given time interval after the first fingerprint image is 
30 captured is referred to as a second fingerprint image, the comparison section 30 compares the first fingerprint image 
with the second fingerprint image. The comparison section 30 detects the deviation and the like of the second fingerprint 
image with respect to the first fingerprint image as the moving direction, moving distance, and rotational angle, for 
example. 

[0075] The image generation section 40 generates image information displayed in the display section 50. The image 
35 generation section 40 is capable of generating the image information which is changed while reflecting comparison 
results (detection results) of the comparison section 30. For example, the image generation section 40 scrolls the 
information displayed in the display section 50 or moves a pointer (arrow) displayed in the display section 50 corre- 
sponding to the movement of the finger. The comparison section 30 and the image generation section 40 may be 
realized by a microcomputer, DSP, or dedicated IC chip which executes a given program stored in a memory, for 
40 example. 

[0076] The display section 50 displays an image based on the image information generated by the image generation 
section 40. A liquid crystal panel may be used as the display section 50, for example. In this case, the display section 
50 is driven by a liquid crystal driver circuit (not shown) using a voltage corresponding to the image information. 
[0077] The information device 1 0 can extract minutiae points of a fingerprint image and detect movement or the like 
45 of the fingerprint image based on the minutiae points to reduce the processing load to the comparison section 30. 
Therefore, the information device 1 0 may include the minutiae point extraction section 60. The minutiae point extraction 
section 60 is capable of detecting a ridge (peak or projecting section) of a fingerprint image and determining ridge 
bifurcations and ridge endings. 

[0078] FIGS. 2A and 2B show minutiae points of a fingerprint. 

so [0079] FIG. 2A shows ridge bifurcations of a fingerprint; and FIG. 2B shows ridge endings of a fingerprint. Ridge 
bifurcations of a fingerprint are extracted by the minutiae point extraction section 60 from a fingerprint image captured 
by the fingerprint image capture section 20, for example. In FIGS. 2A and 2B, the fingerprint image shows the ridges 
(projecting sections) of a fingerprint. A ridge bifurcation is a portion at which a ridge divides into two or more branches. 
A ridge ending is a portion at which a ridge ends. 

55 / [0080] Since a fingerprint is unique, distribution of ridge bifurcations or ridge endings differs between individuals. 
^ Therefore, if ridge bifurcations or ridge endings can be determined, it suffices to merely compare the distribution of 
ridge bifurcations or ridge endings. This reduces the amount of information to be compared, whereby the load of com- 
parison processing can be reduced. 
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[0081] In FIG. 1 , the comparative section 30 compares the distribution of minutiae points including ridge bifurcations 
and ridge endings of the first and second fingerprint images, and calculates the moving distance, moving direction, 
moving velocity, and rotational angle from the positional deviation of the corresponding minutiae points. The image 
generation section 40 generates an image by scrolling an image to be displayed or moving a pointer corresponding to 
5 the moving distance, moving direction, moving velocity, and rotational angle calculated by the comparison section 30. 
The display section 50 displays the image generated by the image generation section 40 corresponding to the com- 
parison results of the comparison section 30, 
[0082] FIGS. 3A and 3B show examples of display control. 

[0083] FIG. 3A schematically shows scrolling of an image. In the case where display information 70 is displayed in 
10 a display region 72 in the display section 50, the display region is moved to a display region 74 corresponding to the 
movement of the corresponding minutiae points of two fingerprint images and the display information 70 is displayed 
in the display region 74. 

[0084] FIG. 3B schematically shows the movement of the pointer. A pointer 82 displayed in a display region 80 of 
the display section 50 is moved corresponding to the movement of the corresponding minutiae points of two fingerprint 

15 images, and a pointer 84 is displayed. 

[0085] In the information device 10 including the fingerprint image capture section 20 and the display section 50, 
minutiae points of fingerprint images captured at least twice by the fingerprint image capture section 20 are extracted, 
and display control such as scroll control or pointer control in the display section 50 is performed corresponding to the 
movement of the minutiae points. Therefore, display control of the display section can be performed by using a simple 

20 configuration while preventing occurrence of malfunction and reducing the processing load. Moreover, since display 
control is performed corresponding to the movement of the finger, display control can be performed with high accuracy. 
[0086] In the information device shown in FIG. 1 , since display control is not performed if minutiae points are not 
associated with each other, occurrence of malfunction can be prevented. However, it is more ideal to perform the 
above-described display control after checking the operator by using the fingerprint image captured by the fingerprint 

25 image capture section 20. This enables the information device to be applied to an IC card such as a credit card or a 
cash card for which a high degree of security protection is required. 

[0087] A configurational example of an information device which verifies the operator is schematically shown in FIG. 

4. 

[0088] In this figure, sections the same as those of the information device 10 shown in FIG. 1 are indicated by the 

30 same symbols. Description of these sections is appropriately omitted. 

[0089] In an information device 100, the fingerprint image captured by the fingerprint image capture section 20 is 
used in a check section 110. The check section 110 checks whether or not the captured fingerprint image is the fin- 
gerprint image of the registered person by comparing the captured fingerprint image with registration information 120 
registered in advance. If the check section 110 determines that the captured fingerprint image is identical with the 

35 registration information 1 20, the check section 1 1 0 instructs a comparison section 1 30 to start the comparison process- 
ing for display control. 

[0090] The comparison section 130 differs from the comparison section 30 shown in FIG. 1 in that the comparison 
section 130 performs the comparison processing on condition that the fingerprint image is checked by the check section 
110. The comparison processing of the comparison section 130 is the same as the comparison processing of the 

40 comparison section 30. 

[0091] The check section 110 may use minutiae points of a fingerprint image in order to reduce the processing load. 
So the information device 1 00 may include a minutiae point extraction section 1 40. The minutiae point extraction section 
140 extracts ridge bifurcations and ridge endings of a fingerprint image in the same manner as the minutiae point 
extraction section 60. Information on minutiae points is registered in advance in the registration information 1 20. Wheth- 

45 er or not a captured fingerprint image is identical with the fingerprint image of a registered person is determined from 
the minutiae points with less processing load. Though the minutiae point extraction sections 60 and 1 40 are separated 
in FIG. 4, they may be disposed in a single block. 

[0092] FIGS. 5 and 6 show an example of an operation flow of the information device 100. 

[0093] A fingerprint is detected by the fingerprint image capture section 20 (step S 1 50), whereby a fingerprint image 
50 is captured. As a result, a fingerprint image for check (first fingerprint image) is generated (step S1 51 ). The fingerprint 
image for check is used in the check section 110. 

[0094] The check section 1 1 0 compares the minutiae point of the fingerprint image for check extracted by the minutiae 
point extraction section 140 with the minutiae point of the fingerprint image registered in the registration information 
120 to verify the fingerprint images (steps S152 and S153). 
55 [0095] If it is determined that the fingerprint image for check is not identical with the registration information 120 (step 
S1 53: N), use inhibition processing is performed (step S154), and processing is terminated (END). As the use inhibition 
processing, indication to the effect that the fingerprint image cannot be verified may be displayed in the display section 
50, or the information device may be caused to transition to a power off state, for example. 
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[0096] If it is determined that the fingerprint image for check is identical with the registration information 120 in the 
step S1 53 (step S1 53: Y), the position of the minutiae point of the fingerprint image for check used for check is specified 
(step S 155). The position of the minutiae point is the coordinates (absolute value) of the minutiae point extracted by 
the minutiae point extraction section 1 40. The coordinates of the minutiae point may be the position in the coordinate 
5 space specified for the fingerprint image capture section 20 to capture the fingerprint image (position on the detection 
surface of the fingerprint sensor, for example). 

[0097] A fingerprint is then detected by the fingerprint image capture section 20 (step S 156), whereby a fingerprint 
image is captured. As a result, a display control fingerprint image (second fingerprint image) is generated (step S157). 
The display control fingerprint image is used in the comparison section 130. 

w [0098] The minutiae point extraction section 60 extracts the minutiae point of the display control fingerprint image 
(step S158), and specifies the position of the minutiae point of the display control fingerprint image (step S 159). The 
comparison section 130 compares the position of the minutiae point of the fingerprint image for check (first fingerprint 
image) with the position of the minutiae point of the display control fingerprint image (second fingerprint image) (step 
S160). In more detail, the comparison section 130 calculates the deviation of the coordinates of the minutiae point of 

15 the display control fingerprint image with respect to the coordinates of the minutiae point of the fingerprint image for 
check as the moving distance, moving direction, moving velocity, and rotational angle (step S161). Therefore, if the 
minutiae point of the display control fingerprint image corresponding to the minutiae point of the fingerprint image for 
check cannot be found, display control cannot be performed. Therefore, unintentional malfunction by the registered 
person or an operation performed by a person other than the registered person can be prevented. 

20 [0099] The scroll distance, scroll direction, scroll velocity, and scroli rotational angle or the moving distance, moving 
direction, moving velocity, and rotational angle of the pointer are then determined based on the moving distance, moving 
direction, moving velocity, and rotational angle calculated in the step S161 (step S162), and the image is displayed in 
the display section 50 (step S163). 

[0100] Whether or not a fingerprint image can be captured is determined (step S164). If it is determined that a fin- 
25 gerprint image can be captured (step S164: Y), the operation is returned to the step S 156, and the fingerprint image 
capture section 20 captures a fingerprint image as the display control fingerprint image. Display control of the display 
section 50 can be performed in the same manner as described above by detecting the deviation of the position of the 
minutiae point of the display control fingerprint image captured at this time with respect to the position of the minutiae 
point of the display control fingerprint image captured last time. 
30 [0101 ] If it is determined that a fingerprint image cannot be captured in the step S1 64 (step S1 64: N), if the operation 
is finished (step S1 65: Y), processing is terminated (END). If the operation is not finished (step S1 65: N), the operation 
is returned to the step S 150 and the fingerprint image capture section 20 captures the fingerprint image for check. 
[0102] The information device 1 00 checks the fingerprint by using the captured fingerprint image. After the fingerprint 
is checked, display control is performed corresponding to the deviation of the fingerprint image captured again with 
35 respect to the checked fingerprint image. In this case, check and detection of the deviation are performed by using 
minutiae points of the fingerprint images. This enables display control of the display section to be performed while 
preventing occurrence of malfunction and maintaining security protection. 
[0103] The information device 100 shown in FIG. 4 is described below in more detail. 

40 2. Detailed description of information device 

[0104] FIG. 7 is a block diagram showing a detailed configurational example of the information device 100. 
[0105] Each section of the information device 1 00 is controlled by a central processing unit (hereinafter abbreviated 
as CPU) 21 0 connected with a bus 200 according to a program stored in a read only memory (hereinafter abbreviated 
45 as ROM) connected with the bus 200. The CPU 21 0 performs various types of processing by using a dynamic random 
access memory (DRAM) 21 4 as a temporary storage device as a work area. As the temporary storage device, a static 
random access memory (SRAM) may also be used. 

[0106] The CPU 210 reads card information stored in a nonvolatile memory 216 as a long-term storage device or 
writes the card information in the nonvolatile memory 216. The card information is personal information for which a 
50 high degree of security protection is necessary (balance at the bank, for example). Therefore, in the case of writing 
the card information in the nonvolatile memory 21 6, the card information is encrypted by using an encoder (encryption 
device) 218. In the case of reading the card information from the nonvolatile memory 216, the card information is 
decrypted (decoded) by using a decoder (decryption device) 220. As the nonvolatile memory 216, a flash memory or 
SRAM may be used. 

55 [01 07] A display controller (display control section) 222 and a VRAM 224 are connected with the bus 200. The display 
controller 222 displays an image in a display (display section) 226 based on image data stored in the VRAM 224. 
[0108] A sensor controller (personal information collection section control section) 228 and a sensor RAM 230 are 
connected with the bus 200. The sensor controller 228 detects ridges and valleys of a fingerprint by a fingerprint sensor 
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(personal information collection section or fingerprint image capture section) 232, and stores an image corresponding 
to the ridges and valleys in the sensor RAM as a fingerprint image. 

[01 09] The function of the fingerprint image capture section 20 is realized by the fingerprint sensor 232. The functions 
of the comparison sections 30 and 1 30, the image generation section 40, the check section 110, and the minutiae point 
5 extraction sections 60 and 140 are realized by the CPU 210 which executes the program stored in the ROM 212. The 
function of the display section 50 is realized by the display 226. The registration information 120 is stored in the ROM 
212 or the nonvolatile memory 216. 

[0110] The present invention is not limited to the configuration in which each element of the present invention is 
realized by the device shown in FIG. 7. For example, minutiae points of a fingerprint image are not necessarily extracted 
10 by software manner, and they may be extracted by hardware such as a general-purpose chip or a dedicated chip. 
Configuration in which the nonvolatile memory 216 can be accessed without using the encoder 218 and the decoder 
220 may be employed. In this case, the nonvolatile memory 216 may be accessed while allowing the CPU 210 to 
encode or decode the card information. 

[0111] A fingerprint sensor which is suitably used in the case where the information device 100 is applied to an IC 
15 card is described below in detail. 

2.1 Fingerprint sensor 

[01 1 2] There are various methods of detecting fingerprints by using the fingerprint sensor 232 as a fingerprint image 
20 capture section, and fingerprint detection methods are not limited insofar as a fingerprint image is captured. However, 
reduction of space can be realized by using conventional manufacturing technology and ridges and valleys of a fin- 
gerprint can be detected with high accuracy by using a capacitance detection type of fingerprint sensor described 
below as the fingerprint sensor 232. 

[0113] A configurational example of the fingerprint sensor 232 is shown in FIG. 8. 

25 [0114] The fingerprint sensor 232 includes M (M is an integer of two or more) power supply lines 240, and N (N is 
an integer of two or more) output lines 242. A capacitance detection element 244 is provided at each intersecting point 
of the M power supply lines 240 and the N output lines 242. The capacitance detection element 244 is illustrated as a 
closed circuit when a finger is in contact with the capacitance detection element 244. The capacitance detection element 
244 includes a variable capacitor C F of which the capacitance is changed depending on the ridge and valley pattern 

30 of a fingerprint, and a signal amplification element such as a signal amplification MIS thin film semiconductor device 
(hereinafter abbreviated as "signal amplification TFT") 246. If a finger is not in contact with the capacitance detection 
element 244, a grounding terminal of the variable capacitor C F is in an open state. The variable capacitor C F is described 
later. 

[0115] The M power supply lines 240 are connected with drains D of the N signal amplification TFTs 246 arranged 
35 along the corresponding row. The M power supply lines 240 are connected with a common power supply line 252 
through M power supply pass gates 250. Specifically, the power supply pass gate 250 is formed by a MIS thin film 
semiconductor device. A source S of the power supply pass gate 250 is connected with the power supply line 240, 
and a drain D of the power supply pass gate 250 is connected with the common power supply line 252. A power supply 
shift register 262 is provided inside a power supply select circuit 260 in addition to the M power supply pass gates 250 
40 and the common power supply line 252. A gate G of each of the M power supply pass gates 250 is connected with a 
power supply select output line 264 of the power supply shift register 262. 

[0116] The N output lines 242 are connected with sources S of the M signal amplification TFTs 246 arranged along 
the corresponding column. The N output lines 242 are connected with a common output line 272 through N output 
signal pass gates 270. Specifically, the output signal pass gate 270 is formed by a MIS thin film semiconductor device. 
45 A drain D of the output signal pass gate 270 is connected with the output line 242, and a source S of the output signal 
pass gate 270 is connected with the common output line 272. An output signal shift register 282 is provided inside an 
output signal select circuit 280 in addition to the N output signal pass gates 270 and the common output line 272. A 
gate G of the output signal pass gate 270 is connected with an output select output line 284 of the output signal shift 
register 282. 

50 [0117] FIG. 9 is a cross-sectional view showing the capacitance detection element 244 of FIG. 8. 
[0118] A finger not in contact with the capacitance detection element is shown in this figure. 
[0119] The capacitance detection element 244 includes a signal detection element 248 in addition to the signal 
amplification TFT 246 which is the signal amplification element. 

[0120] In FIG. 9, a semiconductorfilm 291 including a source region 291 A, a drain region 291 B, and a channel region 
55 291 C formed between the source region 291 A and the drain region 291 B is formed on an insulating layer 290. A gate 
insulating film 292 is formed on the semiconductor film 291 . A gate electrode 293 is formed in a region which faces 
the channel region 291 C with the gate insulating film 292 interposed therebetween. The semiconductor film 291 , the 
gate insulating film 292, and the gate electrode 293 make up the signal amplification TFT 246. The power supply pass 



10 



EP1 396 812 A2 



gate 250 and the output signal pass gate 270 are formed in the same manner as the signal amplification TFT 246. 
[0121] The signal amplification TFT 246 is covered with a first interlayer dielectric (insulating film) 294. A first inter- 
connect layer 295 corresponding to the output line 242 shown in FIG. 8 is formed on the first interlayer dielectric 294. 
The first interconnect layer 295 is connected with the source region 291 A of the signal amplification TFT 246. 
[01 22] The first interconnect layer 295 is covered with a second interlayer dielectric 296. A second interconnect layer 
297 corresponding to the power supply line 240 shown in FIG. 8 is formed on the second interlayer dielectric 296. The 
second interconnect layer 297 is connected with the drain region 291 B of the signal amplification TFT 246. As a structure 
differing from the structure shown in FIG. 9, the second interconnect layer 297 may be formed on the first interlayer 
dielectric 294, and the first interconnect layer 295 may be formed on the second interlayer dielectric 296. 
[0123] A capacitance detection electrode 298 is formed on the second interlayer dielectric 296. A capacitance de- 
tection dielectric film 299 is formed to cover the capacitance detection electrode 298. The capacitance detection die- 
lectric film 299 is located on the outermost surface of the fingerprint sensor 232 and functions as a protective film. A 
finger comes in contact with the capacitance detection dielectric film 299. The signal detection element 248 is made 
up of the capacitance detection electrode 298 and the capacitance detection dielectric film 299. 
[0124] A fingerprint is detected by the fingerprint sensor 232 by allowing a finger to come in contact with the capac- 
itance detection dielectric film 299 shown in FIG. 9. In FIG. 8, a signal is sequentially extracted from the M x N capac- 
itance detection elements 244 by providing a power supply voltage to one of the M power supply lines 240 and detecting 
a signal from one of the N output lines 242. 

[0125] The fingerprint detection operation is roughly divided into (I) a case where a ridge (projecting section) of a 
fingerprint comes in contact with the capacitance detection dielectric film 299, and (II) a case where a valley (recess 
section) of a fingerprint faces the capacitance detection dielectric film 299. 

(1) Case where ridge (projecting section) of fingerprint pattern comes in contact with capacitance detection die- 
lectric film 299: 

FIG. 1 0 shows an equivalent circuit of the capacitance detection element 244 in this case. 

[0126] A symbol 310 corresponds to a ridge of a human fingerprint. A grounding electrode 310 which faces the 
capacitance detection electrode 298 shown in FIG. 9 with the dielectric film 299 interposed therebetween is formed in 
a region indicated by the symbol 310. A power supply voltage Vdd is supplied from the common power supply line 
252. A symbol Cj indicates a transistor capacitor of the signal amplification TFT 246. A symbol C D indicates a capacitor 
between the detection electrode 300 and the grounding electrode (finger) 310. 

[0127] The length of the gate electrode of the signal amplification TFT 246 is referred to as L (um), the width of the 
gate electrode is referred to as W (u/n), the thickness of the gate insulating film is referred to as tox (urn), the relative 
dielectric constant of the gate insulating film is referred to as eox, and the dielectric constant under vacuum is referred 
to as eo. The capacitance of the transistor capacitor Cj is expressed as follows. 

C T = eo- eox • L- W/tox 

[0128] The area of the capacitance detection electrode 298 is referred to as S (u.m 2 ), the thickness of the capacitance 
detection dielectric film 299 is referred to as td (jim), and the relative dielectric constant of the capacitance detection 
dielectric film 299 is referred to as ed. The capacitance of the capacitor C D is expressed as follows. 

C D = eo- ed- S/td 

[0129] In the equivalent circuit shown in FIG. 10, a voltage V GT applied to the gate of the signal amplification TFT 
246 is expressed by the following equation (1). 

V GT = Vdd/(1+C D /C T ) (1) 

[01 30] If the capacitance of the capacitor C D is set sufficiently greater than the capacitance of the transistor capacitor 
c t ( c d > 10 x °T' for example), the denominator in the equation (1) becomes infinite, whereby V GT is approximated 
as shown by the following equation (2). 
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V GT =0 (2) 

[0131] As a result, the signal amplification TFT 246 is in an off state since almost no voltage is applied to the gate 
of the signal amplification TFT 246. Therefore, current I which flows between the source and the drain of the signal 
amplification TFT 246 becomes extremely small. The measurement point can be determined to be a ridge (projecting 
section) in a fingerprint pattern by measuring the current I. 

(II) Case where valley (recess section) of fingerprint faces capacitance detection dielectric film 299: 

FIG. 11 shows an equivalent circuit of the capacitance detection element 244 in this case. 



[0132] A symbol 312 corresponds to a valley of a human fingerprint. In this case, a capacitor C A having air as a 
dielectric is formed between the dielectric film 299 and the valley in addition to the capacitor Cq shown in FIG. 10. 
15 [0133] In the equivalent circuit shown in FIG. 1 1 , a voltage V GV applied to the gate of the signal amplification TFT 
246 is expressed by the following equation (3). 



V GV = Vdd/{[1 + (1/C T )] x 1/[(1/C D ) + (1/C A )]} (3) 

[0134] If the capacitance of the capacitor C D is set sufficiently greater than the capacitance of the transistor capacitor 
C T (C D > 10 x C T , for example), the equation (3) is approximated as shown by the following equation (4). 

25 V GV %Vdd/[1+(C A /C T )J (4) 

[0135] If the capacitance of the transistor capacitor Cj is set sufficiently greater than the capacitance of the capacitor 
C A formed by a valley of a fingerprint (C T > 1 0 x C A for example), the equation (4) is approximated as shown by the 
following equation (5). 



V GV =Vdd (5) 

[0136] As a result, the signal amplification TFT 246 is in an on state since the power supply voltage Vdd is applied 
to the gate of the signal amplification TFT 246. Therefore, the current I which flows between the source and the drain 
of the signal amplification TFT 246 is extremely increased. Therefore, the measurement point can be determined to 
be a valley (recess section) of a fingerprint, pattern by measuring the current I. 

[0137] The variable capacitor C F shown in FIG. 8 has a capacitance equal to the capacitance of the capacitor C D 
when a ridge of a fingerprint is in contact with the capacitance detection dielectric film 299, and has a capacitance 
equal to the sum of the capacitance of the capacitor C D and the capacitance of the capacitor C A when a valley of a 
fingerprint faces the capacitance detection dielectric film 299. Therefore, the capacitance of the variable capacitor C F 
varies corresponding to a ridge or a valley of a fingerprint. A ridge or a valley of a fingerprint can be detected by detecting 
the current based on the change in capacitance corresponding to a ridge or a valley of a fingerprint. 
[0138] A fingerprint pattern can be detected by performing the above-described operation in the M x N ((1 , 1) to (M, 
N)) capacitance detection elements 244 arranged as shown in FIG. 12A by time division. In more detail, as shown in 
FIG. 12B, a ridge or a valley of a fingerprint in the first row is detected in the order from the capacitance detection 
element located at (1 , 1) to the capacitance detection element located at (1 , N), and a ridge or a valley of a fingerprint 
in the second row is detected in the order from the capacitance detection element located at (2, 1 ) to the capacitance 
detection element located at (2, N). A ridge or a valley of a fingerprint is sequentially detected in pixel units until a ridge 
or a valley is detected from the capacitance detection element located at (M, N). This enables the fingerprint image as 
shown in FIGS. 2A and 2B to be obtained, for example. 

[0139] In the case where a positive power supply is used as the power supply voltage Vdd, the signal amplification 
TFT 246 is formed by using an enhancement n-type transistor in which a drain current does not flow at a gate voltage 
of about zero. Provided that the gate voltage at which the drain current is minimum (minimum gate voltage) in the 
transfer characteristics of the signal amplification TFT 246 is Vmin, CD > 1 0 x Cj is satisfied by satisfying 0 < Vmin 
<0.1 x Vdd. 

[0140] In the case where a negative power supply is used as the power supply voltage Vdd, the signal amplification 
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TFT 246 is formed by using an enhancement p-type transistor in which a drain current does not flow at a gate voltage 
of about zero. Provided that the gate voltage at which the drain current is minimum (minimum gate voltage) in the 
transfer characteristics of the signal amplification TFT 246 is Vmin, C D > 10 x Cy is satisfied by satisfying 0.1 x Vdd 
< Vmin < 0. 

5 [0141] In the information device 1 00, the fingerprint image can be captured by allowing the fingerprint sensor 232 
having the above configuration to periodically detect the fingerprint. The fingerprint sensor 232 has the following spec- 
ification, for example. 



(a) Size of fingerprint sensor: 20 mm x 20 mm 
10 (b) Resolution: 386 dpi (304 x 304) 

(c) Sampling time of fingerprint image: 36.97 ms 

(d) Frame frequency: 27.05 Hz 

(e) Horizontal scanning period: 121 .6 \xs 

(f) Horizontal scanning frequency: 8.225 kHz 
is (g) Selection period per pixel: 400 ns 



2.2 Operation 

[0142] The operation of each section of the information device 100 is described below while describing the entire 
operation example of the information device 1 00 by using a flowchart. 



2.2.1 Verification processing 



25 



30 



35 



40 



45 



[0143] FIG. 13 shows an example of a verification flow of the information device 100. 

[0144] The CPU 210 of the information device 100 performs the following verification processing according to the 
program stored in the ROM 212. 

[0145] When a start switch 234 of the information device 1 00 is turned on, a reset signal goes active, whereby each 
section excluding the ROM 212 and the nonvolatile memory 216 is initialized. 

[0146] If the CPU 210 detects the release of the reset signal (step S350: Y), the CPU 210 instructs the sensor 
controller 228 to collect fingerprint information (personal information in a broad sense) (step S351). In this example, 
the CPU 21 0 instructs the sensor controller 228 to start capturing a fingerprint image. The sensor controller 228 sends 
a given signal to the fingerprint sensor (personal information collection section) 232, and the fingerprint sensor 232 
reads the fingerprint information. As shown in FIGS. 12A and 12B, the fingerprint information read in pixel units is 
stored in the sensor RAM 230 so that one sheet of a fingerprint image is obtained. 

[0147] The CPU 212 reads an image analysis program (routine) from the ROM 212, and analyzes the fingerprint 
image stored in the sensor RAM 230 (step S352). This allows minutiae points of a fingerprint image to be extracted, 
whereby coordinates of the minutiae points by the fingerprint sensor are determined. 

[0148] As minutiae points of a fingerprint image, ridge bifurcations and ridge endings are used as shown in FIGS. 
2A and 2B. Minutiae points are extracted as follows. After eliminating noise from one sheet of a fingerprint image stored 
in the sensor RAM 230, image processing which allows the ridge (peak or projecting section) to become a thin and 
clear curve is performed. In the case where the ridges which should be connected are cut, processing for complementing 
the ridges is performed. Ridge bifurcations and ridge endings of a fingerprint image are then extracted. 
[0149] After ridge bifurcations and ridge endings are extracted, coordinates of the ridge bifurcations and the ridge 
endings on the electrode matrix of the fingerprint sensor 232 are specified. In the case where k (k is an integer) minutiae 
points are extracted in a fingerprint image captured at a time t, the coordinates of the vectors r t|1 to r t k are determined 
as shown by the following equation (6). 



50 



fx } 

t,a 

y t , a j 



(a = 1, 2, k) 



(6) 



55 



x t a and y t a are coordinates specified by the XY axes on the fingerprint sensor which intersect each other at right 
angles. 

[0150] In the case where the vector r t ,p of the p-th minutiae point exists at a position of (i, j) on the fingerprint sensor 
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matrix, x t p = i and y t p = j are satisfied, whereby the absolute position in the coordinate space for capturing the fingerprint 
image by using the fingerprint sensor 232 is expressed as shown by the following equation (7). 



r ufi m 



(7) 



[0151] The fingerprint image analysis results including the minutiae point information such as the position (coordi- 
nates) of the extracted minutiae point are stored in the DRAM 214. 

[0152] After the analysis of the captured fingerprint image is completed in the step S352 shown in FIG. 13, the CPU 
is 21 0 instructs the decoder 220 to read the personal verification information (registration information in a broad sense) 
from the nonvolatile memory 216 (step S353). The personal verification information (fingerprint minutiae point infor- 
mation; registration information in a broad sense) registered in advance is stored in the nonvolatile memory 216 in an 
encrypted state. The decoder 220 decodes the personal verification information read from the nonvolatile memory 21 6 
and outputs the decoded personal verification information to the CPU 210. 
20 [01 53] The CPU 21 0 compares the personal verification information output from the decoder 220 with the fingerprint 
image stored in the DRAM 214 (step S354). 

[0154] If the personal verification information output from the decoder 220 does not coincide with the fingerprint 
image stored in the DRAM 214 in the step S354 (step S354: N), the CPU 210 creates an image indicating the result 
such as "Verification failed" and stores the image in the VRAM 224 (step S355). 
25 [0155] The CPU 210 instructs the display controller 222 to display the image stored in the VRAM 224 (step S356). 
The display controller 222 sends a given signal to the display 226, and the display 226 displays the image stored in 
the VRAM 224. 

[01 56] If the personal verification information output from the decoder 220 coincides with the fingerprint image stored 
in the DRAM 21 4 in the step S354 (step S354: Y), the CPU 21 0 reads the card information (balance at the bank, for 
30 example) of the verified person from the nonvolatile memory 21 6 through the decoder 220 (step S357), and stores the 
card information in the DRAM 214. The CPU 210 may exchange information with the outside and store the information 
in the DRAM 214. 

[0157] The CPU 210 selects the information to be displayed from the information stored in the DRAM 214, and 
creates an image corresponding to the selected information (step S358). The information on the created image is 
35 stored in the VRAM 224. The CPU 210 instructs the display controller 222 to display the image stored in the VRAM 
224 (step S359). The display controller 222 sends a given signal to the display 226, and the display 226 displays the 
image stored in the VRAM 224. 



2.2.2 Check method 



[0158] The information device 100 uses minutiae points of a fingerprint image when checking the fingerprint image 
in order to reduce the processing load. For example, check uses distribution of minutiae points obtained by repeatedly 
inspecting whether or not the minutiae point information (position of the minutiae point) of a fingerprint as the personal 
verification information read from the nonvolatile memory 21 6 coincides with the positions of minutiae points extracted 

^5 from the captured fingerprint image while moving them. 

[0159] Moreover, numerical information may be provided to each minutiae point. In this case, since it suffices to 
determine whether or not the numerical values coincide with each other for each minutiae point of a fingerprint, the 
processing load necessary for repeatedly checking fingerprint images can be further reduced. 
[0160] As the numerical information added to minutiae points of a fingerprint, a numerical value calculated based 

50 on the positional relation with other minutiae points can be given. The following description illustrates the case where 
the connection relation between each minutiae point is converted into a numerical value and the case where the relation 
between line segments connecting minutiae points and ridges of a fingerprint image is converted into a numerical value. 



2.2.2.1 Converting line segments into numerical value 

[0161] In this method, minutiae points are connected with the closest minutiae point and the second closest minutiae 
point by straight lines. This allows a plurality of line segments to be drawn from each minutiae point, whereby the 
lengths of the line segments and the angle formed by the line segments can be provided to each minutiae point as 
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numerical information. Therefore, in the case where each minutiae point is compared with the registration information 
having numerical information on each minutiae point, since it suffices to merely compare the numerical values for each 
minutiae point, complicated check processing requiring strictness can be performed with less processing load. 
[0162] FIG. 14 shows an example of connecting minutiae points of a fingerprint image. 

s [0163] Ridge bifurcations are used as minutiae points in this figure. A plurality of line segments are drawn from each 
minutiae point. Taking a minutiae point P as an example, the closest minutiae point to the minutiae point P is a minutiae 
point P\ and the second closest minutiae point to the minutiae point P is a minutiae point P". The closest minutiae 
point to a minutiae point P ,n is the minutiae point P\ and the second closest minutiae point to the minutiae point P m is 
the minutiae point P. Therefore, the minutiae point P is associated with three line segments with the minutiae point P 

10 as the starting point, specifically, a line segment which connects the minutiae point P and the minutiae point P', a line 
segment which connects the min utiae point P and the minutiae point P" , and a line segment which connects the minutiae 
point P and the minutiae point P"\ The numerical information including the angle formed by two line segments selected 
from the three line segments and the length of each line segment is added to each minutiae point. 
[0164] Therefore, N (N is an integer of two or more) connection lines are drawn from each minutiae point, and N 

is pieces of line segment length information is provided to each minutiae point corresponding to the N connection lines. 
In addition, N C 2 pieces of angle information is determined. In FIG. 15A, three connection lines are drawn with a minutiae 
point P 1 as the starting point, and three pieces of line segment length information and 3 C 2 (= 3) pieces of angle infor- 
mation are provided to the minutiae point P 1 . Provided that the three line segments are referred to as L 12 , L 13 , and L 14 
and the angle formed by the line segment L,, and the line segment is referred to as G^j, (L 12 , L 13 , L 14 , G 123 , 9 142 , 

20 and 9 143 ) is provided to the minutiae point P A as the fingerprint information used for check and comparison. The char- 
acteristic numerical values are assigned to each minutiae point in this manner (FIG. 15B). 

[0165] As shown in FIG. 16, inner product values IP of two line segments may be provided as information associated 
with a minutiae point. The N C 2 inner products IP are provided to a minutiae point from which N line segments are 
drawn. In FIG. 15A, three inner products IP^ (= L ir Ly cosG.,jj) are provided. 

25 [0166] Each minutiae point and the numerical information characteristic of the minutiae point are provided in this 
manner. If k minutiae points exist in the fingerprint, k pieces of numerical information are obtained corresponding to 
the k minutiae points. In the case of checking or comparing the fingerprints, whether or not the numerical information 
coincides within a given error range is determined, and personal verification or finger position comparison is performed 
based on the rate of coincidence. As shown in FIG. 15C, in the case where the line segment length information and 

30 the angle information are provided to the minutiae point, a minutiae point P, characterized by characteristic numerical 
information (L l1( L j2 , L j3 , G j2 , G j13 , and G i23 ) is recognized in reference information (registration information at the time 
of check or minutiae point information in the last frame at the time of comparison), and a minutiae point Pj characterized 
by characteristic numerical information (L^, L ]2 , L j3 , 9 j12 , G j13 , and G j23 ) is recognized in collected information (minutiae 
point information obtained in the current frame). If at least two pieces of line segment length information and the angle 

35 formed by these line segments in the numerical information coincide between the minutiae points P { and Pj, the minutiae 
points Pj and Pj can be determined to be the same minutiae point. In checking a fingerprint, at least four minutiae points 
should coincide with the minutiae points in the registration information. In position comparison, at least two (ideally 
three or more) minutiae points should coincide between the previous frame and the current frame. 
[01 67] Although minutiae points may be connected irrespective of ridge bifurcations and ridge endings, they may be 

40 selectively connected. Ridge bifurcations may be connected to one another and ridge endings may be connected to 
one another. By considering connection conditions, more strict check can be achieved. 

2.2.2.2 Converting relationship between ridges into numerical value 

45 [0168] In this method, minutiae points are connected by a straight line. Since the lines connecting minutiae points 
intersect ridges of a fingerprint image, the number of times a line associated with a minutiae point intersects the ridges 
may be provided as the numerical information. In this case, in the case where each minutiae point is compared with 
the registered information having the numerical information on each minutiae point, since it suffices to merely compare 
the numerical values for each line segment which connects minutiae points, the check processing which is complicated 

50 and for which strictness is required can be performed while reducing the processing load. 
[0169] FIG. 1 7A shows an example of connecting minutiae points of a fingerprint image 

[0170] Line segments thus connect minutiae points. For example, the minutiae point P is connected to the minutiae 
points P' and P" by line segments. The line segment LL 1 connecting the minutiae point P and the minutiae point P' and 
not intersecting any ridge of a fingerprint provides "0" as the numerical information (or ridge information) "0" , and the 
55 line segment LL 2 connecting the minutiae point P and the minutiae point P" and intersecting four ridges provides "4" 
as the numerical information. 

[0171] This enables the ridge information including the number of times the line segment LL X drawn from each mi- 
nutiae point to other minutiae point crosses ridges of a fingerprint to be provided to each minutiae point, as shown in 
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FIG. 1 7B. Specifically, a combination of the number of times two line segments cross ridges of a fingerprint is provided 
to the minutiae points P and P' as the ridge information. A combination of the number of times four line segments cross 
ridges of a fingerprint is provided to the minutiae point P" as the ridge information. Since it suffices to merely compare 
the minutiae points by using the number of times the line segments cross ridges of a fingerprint included in the ridge 
5 information provided to each minutiae point, the check processing can be performed while reducing the processing load. 

2.2.3 Display control processing 

[0172] A specific example of display control processing performed after the verification processing shown in FIG. 13 
10 is described below. 

[0173] FIG. 18 shows an example of a flow of display control processing of the information device 100. 
[0174] If the captured fingerprint image is determined to be the fingerprint image of the registered person by the 
verification processing shown in FIG. 13, the CPU 210 of the information device 100 performs the following display 
control processing according to the program stored in the ROM 212. 

15 [0175] The CPU 210 instructs the sensor controller 228 to collect the fingerprint information (step S370). In this 
example, the CPU 210 instructs the sensor controller 228 to start capturing a fingerprint image. The sensor controller 
228 sends a given signal to the fingerprint sensor (personal information collection section) 232, and the fingerprint 
sensor 232 reads the fingerprint information. As shown in FIGS. 1 2A and 1 2B, the fingerprint information read in pixel 
units is stored in the sensor RAM 230 so that one sheet of a fingerprint image is obtained. 

20 [01 76] I n the case where the fingerprint sensor 232 repeatedly captures fingerprint images at a given frame frequency, 
if the verification processing shown in FIG. 1 3 is completed in a frame cycle, a fingerprint image (frame f , for example) 
captured in the step S370 is a fingerprint image in a frame next to the frame (frame (f + 1 ), for example) of a fingerprint 
image captured in the step S351 in FIG. 13. 

[0177] The CPU 212 reads the image analysis program (routine) from the ROM 212, and analyzes the fingerprint 
25 image stored in the sensor RAM 230 (step S371). This allows minutiae points of a fingerprint image to be extracted, 
and coordinates of the minutiae points on the fingerprint sensor to be determined. As minutiae points of a fingerprint 
image, ridge bifurcations and ridge endings are used. Analysis results of a fingerprint image including the minutiae 
point information such as the position (coordinates) of the extracted minutiae points are stored in the DRAM 21 4. 
[0178] The CPU 210 compares the new fingerprint image analysis results with the old fingerprint image analysis 
30 results to specify the movement of the finger on the fingerprint sensor (step S372). The new fingerprint image analysis 
results are analysis results for the display control fingerprint image (second fingerprint image) obtained in the step 
S371 . The old fingerprint image analysis results are analysis results for the fingerprint image for check (first fingerprint 
image) obtained in the step S351 in the verification processing shown in FIG. 13. 

[0179] In more detail, k minutiae points are obtained from the fingerprint image for check captured at a time t1 and 
35 expressed by the following equation (8). 



40 r ,\,a = 



fx } 

< y,l ' a J 



(a=l,2,...,k) (8) 



45 m (m is an integer) minutiae points are obtained from the display control fingerprint image captured at a time t2 

and expressed by the following equation (9). 



50 



r a,p 



fx \ 



(P=l,2,..., m) 



(9) 



55 [0180] A parallel translation vector d and rotational transformation S are applied to the vector r t1 0 to obtain a vector 
r' t1a as shown by the following equation (10). 
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[01 81 J The parallel translation vector d is expressed by the following equation (11 ). 



(10) 



10 



d = 



f 



(11) 



15 [0182] The rotational transformation S is expressed by the following equation (12). 



20 



s = 



^cos 6 - sin 0 ^ 
sin 6 cos 0 



(12) 
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55 



[0183] The resulting vector r* t1 a (equation (1 0)) and vector r^ p (equation (9)) are compared, and the transformation 
operation is repeated while changing the values for x d , y d> and 0 until the vectors coincide at least at three points, for 
example. In the case where the vector r* t1 a and the vector r G p do not coincide even if the transformation operation is 
repeated a predetermined number of times, it is determined that the fingerprint image is not the fingerprint image of a 
person to be verified. 

[0184] Both the check processing in the step S354 shown in FIG. 13 and the comparison processing in the step 
S372 shown in FIG. 1 8 are performed by using minutiae points of fingerprint images. The check processing compares 
the registration information with a fingerprint image for check. The comparison processing compares the fingerprint 
image for check with the display control fingerprint image. Since the check processing determines whether or not a 
fingerprint image is the fingerprint image of a registered person, it is preferable to perform the check processing more 
strictly than the comparison processing. Therefore, it is preferable to perform the check processing by making conditions 
that at least four minutiae points coincide with the registered minutiae points, by checking the fingerprint image with 
the registration information using the fingerprint images captured in a plurality of frames, or by frequently checking the 
fingerprint images (in each frame or at an interval of several frames, for example). Since the comparison processing 
merely compares the fingerprint image in the last frame with the fingerprint image in the current frame, it is possible 
to calculate the moving distance, moving direction, moving velocity, and rotational angle when at least two minutiae 
points coincide. 

[0185] FIG. 19 shows fingerprint images in a frame f and in the next frame (f + 1). 

[0186] In this figure, the minutiae points of each fingerprint image are shown by using black points. If the minutiae 
points Pf 1 to P f 3 in the frame fare associated with the minutiae points P f+1 -j to P f+1f3 in the frame (f + 1) by repeating 
the above transformation operation, the parallel translation vector d and the rotational transformation S can be calcu- 
lated. Specifically, the moving distance, moving direction, rotational angle, and moving velocity can be specified. 
[0187] If the movement of the finger can be specified in the step S372 shown in FIG. 1 8, the CPU 210 creates a new 
image corresponding to the movement of the finger from the information stored in the DRAM 214 (step S373), and 
stores the new image information in the VRAM 224. Specifically, since the parallel translation vector d and the rotational 
transformation S are specified in the step S372, an image in which the display region in the display space is moved in 
proportion to the parallel moving distance Idl on the fingerprint sensor 232, or an image in which the display space is 
moved in a state in which the display region is fixed can be generated. The rotational transformation S is applied to 
the display space in the same manner as described above. 

[0188] The CPU 21 0 instructs the display controller 222 to display the image stored in the VRAM 224 (step S374). 
The display controller 222 sends a given signal to the display 226, and the display 226 displays the image stored in 
the VRAM 224. 

[0189] If the processing is finished (step S375: Y), processing is terminated (END). If the processing is not finished 
(step S375: N), the operation is returned to the step S370. 

[0190] In the case where it is necessary to store new information (new balance at the bank, for example) for a long 
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period of time by using the card, the CPU 21 0 sends the new information to the encoder 21 8. The encoder 21 8 encrypts 
the new information and stores the encrypted information in the nonvolatile memory 21 6. 
[0191] FIG. 20 shows an example of a display space and a display region. 

[0192] As shown in FIG. 20, in the case where an arbitrary region of a display space 400 can be set as the display 
5 region of the display 226, display control in which a display region 41 0 is moved on the display space 400 or the display 
space 400 is moved in a state in which the display region 410 is fixed can be performed. 

[0193] The display region 410 in the frame f is set at a position shown in FIG. 21 . FIG. 22 shows an image obtained 
by using the parallel translation vector d and the rotational transformation S calculated by comparing minutiae points 
of a fingerprint image extracted in the frame f with minutiae points of a fingerprint image extracted in the next frame (f 
10 +1). 

[0194] This is an image obtained when a finger is moved downward and rotated clockwise on the fingerprint sensor 
232, and the display region 41 0 is moved downward and rotated clockwise with respect to the fixed display space 400 
(forward direction). Alternatively, this is ah image obtained when a finger is moved upward and rotated counterclockwise 
on the fingerprint sensor, and the display space 400 is moved upward and rotated counterclockwise with respect to 
is the fixed display region 41 0 so that the display space 400 is pulled by the finger in a state in which the display region 
is fixed (backward direction). 

2.2.4 Calculation examples 

20 [0195] The image information which is changed corresponding to the movement of the finger on the fingerprint sensor 
in the step S373 shown in FIG. 18 is generated by performing the following operation for the display space in the frame 
f, for example. 

[0196] In the following description, the frame frequency of the fingerprint sensor 232 is referred to as f FP (Hz) and 
the frame frequency of the display 226 is referred to as f D | S (Hz). 
25 [01 97] The parallel translation vector d and the rotational transformation S(G) between the fingerprint image captured 
in the frame at the time t1 and the fingerprint image captured in the next frame (t2 = t1 + 1/f FP ) are calculated as follows. 
[0198] The parallel translation velocity vector v is expressed by the following equation (13). 

30 V-fFp-Z (13) 

[0199] The rotational velocity v is expressed by the following equation (14). 



35 



45 



50 



v = f Fp .e (14) 



[0200] The scroll amount of the display region on the display space orthe moving amount of the pointer is determined 
provided that the scroll movement coefficient is k^ (when k^ = 1 , the movement of the finger is the same as the scroll 
velocity or the movement of the finger is the same as the moving velocity of the pointer), and the rotational velocity 
40 coefficient is k sr (when kg r = 1 , the rotational velocity of the finger coincides with the scroll rotational angle or the 
rotational velocity of the finger coincides with the rotational velocity of the pointer). 

[0201] The parallel translation vector d dis between the frame f and the next frame (f + 1 ) is calculated as shown by 
the following equation (15). 



d dis = 7 — = k sd-^ d ( 15 ) 



'DIS 'DIS 



[0202] The rotational angle G dis is calculated as shown by the following equation (1 6). 



* k sr V f FP 
'DIS T DIS 



55 [0203] Therefore, the rotational transformation S djs (6 dis ) is calculated as shown by the following equation (1 7). 
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( cosft 



'dis 



-sinfl 



'dis 




cosfr 



(17) 



v 



'dis 



'dis 



[0204] Therefore, the display region to be displayed in the frame (f + 1) can be specified by calculating the vector 
r dis in the frame f as follows. 



Kis = S<iis (~&<ns ) (transformation in backward direction) (19) 

[0205] The position of the pointer after being moved can be calculated in the same manner as described above. In 
the case of moving the pointer, it is preferable that the pointer be moved in the forward direction with respect to the 
operator. 

[0206] The scroll movement coefficient and the rotational velocity coefficient k sr are preferably in the range of 
0.5 to 2 (0.5 < <2 and 0.5 < < 2). This enables the movement of the finger to be almost in synchronization with 
- the movement of the display screen, whereby handling (operation or control) of the information device (information 
equipment) becomes comfortable. 

3. Frequency switching 

[0207] Since the IC card or the like to which the information device 1 00 is applied is a portable type, the amount of 
power consumption must be small. Therefore, power consumption can be reduced by making the frame frequency 
(capture frequency) of the fingerprint sensor variable taking the use conditions for the fingerprint sensor 232 into con- 
sideration. 

[0208] FIG. 23 shows an example of control processing of a frame frequency of the fingerprint sensor. 
[0209] The following description illustrates the case where scroll control is performed after fingerprint check. 
[0210] The fingerprint sensor 232 is set to a low speed mode (step S450). The low speed mode is a mode in which 
the fingerprint sensor captures a fingerprint image at a frame frequency of 0.3 to 3 Hz, for example. The fingerprint 
sensor is set to the low speed mode when the fingerprint sensor does not necessarily follow the movement of the 
finger. Therefore, it is preferable to reduce unnecessary power consumption by capturing the fingerprint image at low 
speed. 

[0211] After the fingerprint is collected in the low speed mode (step S451), the presence or absence of a fingerprint 
image is determined (step S452). 

[0212] If it is determined that no fingerprint image is captured (step S452: N), it is determined that a finger is not in 
contact with the fingerprint sensor. Therefore, the operation is returned to the step S451 , and a fingerprint is collected. 
[0213] If it is determined that a fingerprint image is captured (step S452: Y), minutiae points of the fingerprint image 
are extracted, and the positions of the extracted minutiae points are stored (step S453). 

[0214] The fingerprint sensor 232 is then set to a high speed mode (step S454). The high speed mode is a mode in 
which the fingerprint sensor captures a fingerprint image at a frame frequency of 10 to 100 Hz, for example. The 
fingerprint sensor is set to the high speed mode when the fingerprint sensor must follow the movement of the finger, 
and it is necessary to capture the fingerprint image at high speed. However, it is preferable to operate the fingerprint 
sensor at a minimum frequency which allows the fingerprint sensor to follow the movement of the finger in order to 
reduce power consumption. An ideal frequency is 20 to 40 Hz. 

[0215] After the fingerprint is collected in the high speed mode (step S455), the presence or absence of a fingerprint 
image is determined (step S456). 

[0216] If it is determined that no fingerprint image is captured (step S456: N), it is determined that a finger is not in 
contact with the fingerprint sensor. Therefore, scroll control is terminated (step S457), and processing is finished (END). 
[0217] If it is determined that a fingerprint image is captured (step S456: Y), minutiae points of the fingerprint image 




S r/« XT*. + duu ) (transformation in forward direction) 



(18) 



or 
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are extracted (step S458), and the extracted minutiae points are compared with the minutiae points of the fingerprint 
collected in the low speed mode and stored in the step S453 (step S459). 

[0218] An image to be displayed in the display 226 is changed by performing scroll control corresponding to the 

moving distance, moving direction, moving velocity, and rotational angle (step S460). 
5 [0219] The position of the minutiae point before being moved is updated at the position of the minutiae point after 

being moved extracted in the step S458 (step S461). The operation is returned to the step S455, and scroll control is 

repeated corresponding to the movement of the next fingerprint collected by the fingerprint sensor 232. 

[0220] Unnecessary power consumption can be reduced by taking the use conditions for the fingerprint sensor 232 

into consideration and increasing the capturing speed only in the case where the fingerprint image must be captured 
10 at high speed. The check processing is omitted in FIG. 23. It is preferable that the frame frequency when capturing at 

least the fingerprint image used for check (first fingerprint image) be lower than the frame frequency when capturing 

the fingerprint image used for display control (second fingerprint image). 

[0221] In the case where the fingerprint sensor 232 periodically captures the fingerprint images, it is preferable to 
allow the fingerprint sensor to operate only in the case where the fingerprint image is captured. 
15 [0222] FIG. 24 shows a finger 500 of an operator to be verified by the fingerprint sensor 232 of the information device 
100 applied to an IC card. 

[0223] As shown in FIG. 9, the capacitance detection dielectric film 299 is formed on the detection surface of the 
fingerprint sensor 232. Therefore, if it can be detected whether or not the finger of the operator is in contact with the 
capacitance detection dielectric film 299, the operation of the fingerprint sensor 232 which periodically scans the fin- 
20 gerprint can be terminated or the operating frequency of the fingerprint sensor 232 can be decreased corresponding 
to the detection results. 

[0224] FIG. 25 shows an example of frequency control processing of the fingerprint sensor according to whether or 
not a finger of an operator is in contact with the detection surface. 

[0225] If the finger of the operator is in contact with the capacitance detection dielectric film 299 (step S51 0: Y), the 
25 fingerprint sensor 232 is set to the high speed mode (step S511), and a fingerprint image is captured by the fingerprint 
sensor 232 at a high frame frequency (step S512). 

[0226] If the finger of the operator is not in contact with the capacitance detection dielectric film 299 (step S51 0: N), 
the fingerprint sensor 232 is set to the low speed mode (step S513), whereby unnecessary power consumption is 
prevented by decreasing the frame frequency. 

30 [0227] After the fingerprint is collected in the high speed mode or the fingerprint sensor 232 is set to the low speed 
mode, if the processing is not finished (Step S514: N), the operation is returned to the step S510. 
[0228] Since the fingerprint sensor is operated at a high frequency only in the case where the fingerprint image must 
be captured at high speed, unnecessary power consumption can be reduced. In FIG. 25, the fingerprint sensor 232 is 
set to the low speed mode. However, the fingerprint sensor 232 may be set to a standby mode in which only a necessary 

35 section is operated and the frequency of the fingerprint sensor is terminated. 

[0229] The present invention is not limited to the above-described embodiment. Various modifications and variations 
are possible within the spirit and scope of the present invention. 

[0230] The above-described embodiment illustrates the case where display control is performed corresponding to 
the movement of the finger. However, the present invention is not limited thereto. For example, the movement of the 

40 finger may be captured as the fingerprint image if the finger is moved in a specific direction (moved in the X axial 
direction or the Y axial direction, or rotated clockwise at 90° around the X axis or the Y axis, for example), and the 
function of the information device may be changed corresponding to the change of the fingerprint image (change in 
position of minutiae points of the fingerprint image, for example). For example, the operation mode of the information 
device may be changed, or a given function may be terminated, or the information device may be turned off. In the 

45 case where the information device has functions of a credit card and other cards as the IC card, the functions of each 
card may be switched corresponding to the movement of the finger. In the case where a recording/reproducing device 
has a plurality of functions, the functions such as reproducing function, fast-forwarding function, and rewinding function 
may be switched. 

[0231] In FIG. 1 or 4, the information device may not include the image generation section 40 and the display section 
50 50. In this case, an information device which is controlled based on the comparison results of the comparison sections 
30 and 130 as the operation information can be provided. 

[0232] Part of requirements of any claim of the present invention could be omitted from a dependent claim which 
depends on that claim. Moreover, part of requirements of any independent claim of the present invention could be 
made to depend on any other independent claim. 

55 
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Claims 

1. An information device comprising: 

5 a fingerprint image capture section which captures a fingerprint image; 

a comparison section which compares a first fingerprint image captured by the fingerprint image capture sec- 
tion with a second fingerprint image captured by the fingerprint image capture section at a given time interval 
after the first fingerprint image is captured; 

an image generation section which generates an image based on the comparison result of the comparison 
io section; and 

a display section which displays the image generated by the image generation section. 

2. The information device as defined in claim 1 , comprising: 

is a minutiae point extraction section which extracts minutiae points of the first and second fingerprint images, 

wherein: 

the comparison section compares positions of the minutiae points of the first and second fingerprint im- 
ages; and 

20 the image generation section uses a moving directions, a moving distance, and a rotational angle between 

corresponding two minutiae points of the first and second fingerprint images and generates an image. 

3. The information device as defined in claim 1 or 2, comprising: 

25 a check section which checks the first fingerprint image with registration information which has been previously 

registered, 

wherein the comparison section compares the first fingerprint image with the second fingerprint image when 
the check section has determined that the first fingerprint image is identical with the registration information. 

30 

4. The information device as defined in claim 3, 

wherein the check section determines whether or not the first fingerprint image is identical with the registration 
information based on a minutiae point of the first fingerprint image. 

35 5. The information device as defined in claim 1 , comprising: 

a minutiae point extraction section which extracts a minutiae point of at least the first fingerprint image; and 
a check section which checks the first fingerprint image with registration information which has been previously 
registered, wherein: 

40 

the comparison section compares the first fingerprint image with the second fingerprint image when the 
check section has determined that the first fingerprint image is identical with the registration information; 
the registration information includes lengths of two line segments and an angle formed by the two line 
segments, the line segments connecting one minutiae point of the fingerprint image with another minutiae 
45 point closest to the minutiae point, and the minutiae point and still another minutiae secondarily closest 

to the minutiae point; and 

the check section checks the first fingerprint image based on: the registration information; lengths of two 
line segments connecting the minutiae point of the first fingerprint image with a minutiae point closest to 
the minutiae point of the first fingerprint image, and the minutiae point of the first fingerprint image and 
50 another minutiae point secondarily closest to the minutiae point of the first fingerprint image; and an angle 

formed by the two line segments drawn from the minutiae point of the first fingerprint. 

6. The information device as defined in claim 1 , comprising: 

55 a minutiae point extraction section which extracts a minutiae point of at least the first fingerprint image; and 

a check section which checks the first fingerprint image with registration information wh ich has been previously 
registered, wherein: 
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the comparison section compares the first fingerprint image with the second fingerprint image when the 
check section has determined that the first fingerprint image is identical with the registration information; 
the registration information includes the number of times a line segment connecting minutiae points of a 
fingerprint image intersects a fingerprint ridge or a fingerprint valley of the fingerprint image; and 
5 the check section checks the first fingerprint based on: the registration information; and the number of 

times a line segment connecting minutiae points of the first fingerprint image intersects a fingerprint ridge 
or a fingerprint valley of the first fingerprint image. 

7. The information device as defined in any one of claims 2, and 4 to 6, 

10 wherein the minutiae point includes at least one of a ridge bifurcation and a ridge ending of a fingerprint. 

8. The information device as defined in any one of claims 1 to 7, 

- wherein a frequency in capturing at least the first fingerprint image is lower than a frequency in capturing the 
second fingerprint image when the fingerprint image capture section periodically captures a fingerprint image. 

15 

9. The information device as defined in any one of claims 1 to 7, 

wherein the fingerprint image capture section: 

has a detection surface for capturing a fingerprint image; 
20 transitions to a high speed mode for operating at a first frequency when a finger is in contact with the detection 

surface; and 

transitions to a low speed mode for operating at a second frequency when a finger is not in contact with the 
detection surface. 

25 10. The information device as defined in any one of claims 1 to 9, 

wherein the image generation section generates an image scrolled based on the comparison result of the 
comparison section. 

11. The information device as defined in any one of claims 1 to 9, 

30 wherein the image generation section generates an image having a pointer moved based on the comparison 

result of the comparison section. 

12. An information device comprising: 

35 a fingerprint image capture section which captures a fingerprint image; 

a comparison section which compares a minutiae point of a first fingerprint image captured by the fingerprint 
image capture section with a minutiae point of a second fingerprint image captured by the fingerprint image 
capture section at a given time interval after the first fingerprint image is captured; 

an image generation section which generates an image, the comparison result of the comparison section 
40 causing the image to be scrolled or a pointer on the image to move; and 

a display section which displays the image generated by the image generation section. 

13. An information device comprising: 

^5 a fingerprint image capture section which captures a fingerprint image; and 

a comparison section which compares a minutiae point of a first fingerprint image captured by the fingerprint 
image capture section with a minutiae point of a second fingerprint image captured by the fingerprint image 
capture section at a given time interval after the first fingerprint image is captured, 

50 wherein a function of the information device is controlled based on the comparison result of the comparison 

section. 

14. An information device comprising: 

55 a fingerprint image capture section which captures a fingerprint image; 

a check section which checks registration information which has been previously registered with a first finger- 
print image captured by the fingerprint image capture section; and 

a comparison section which compares a minutiae point of a first fingerprint image captured by the fingerprint 
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image capture section with a minutiae point of a second fingerprint image captured by the fingerprint image 
capture section at a given time interval after the first fingerprint image is captured, when the check section 
has determined that the first fingerprint image is identical with the registration information, 

5 wherein a function of the information device is controlled based on the comparison result of the comparison 

section. 



10 
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15. A display control method which controls a display section by means of a captured fingerprint image, the display 
control method comprising: 

capturing a first fingerprint image and then a second fingerprint image at a given time interval after the capture 
of the first fingerprint image; 

comparing the first and second fingerprint images; and 

changing a display image based on the comparison result of the first and second fingerprint images. 

16. The display control method as defined in claim 15, comprising: 



extracting minutiae points of the first and second fingerprint images; and 

using a moving directions, a moving distance, and a rotational angle between corresponding two minutiae 
20 points of the first and second fingerprint images and changing the display image. 

17. The display control method as defined in claim 15 or 16, comprising: 

checking the first fingerprint image with registration information which has been previously registered; and 
25 comparing the first and second fingerprint images when the first fingerprint image has been determined to be 

identical with the registration information. 

18. The display control method as defined in claim 17, comprising: 

30 determining whether or not the first fingerprint image is identical with the registration information based on a 

minutiae point of the first fingerprint image. 

19. The display control method as defined in claim 15, comprising: 

35 extracting a minutiae point of at least the first fingerprint image; 

checking the first fingerprint image with registration information which has been previously registered; and 
comparing the first and second fingerprint images when the first fingerprint image has been determined to be 
identical with the registration information, wherein: 

40 the registration information includes lengths of two line segments and an angle formed by the two line 

segments, the line segments connecting one minutiae point of the fingerprint image with another minutiae 
point closest to the minutiae point, and the minutiae point and still another minutiae secondarily closest 
to the minutiae point; and 

the first fingerprint is checked based on: the registration information; lengths of two line segments con- 
45 necting the minutiae point of the first fingerprint image with a minutiae point closest to the minutiae point 

of the first fingerprint image, and the minutiae point of the first fingerprint image and another minutiae 
point secondarily closest to the minutiae point of the first fingerprint image; and an angle formed by the 
two line segments drawn from the minutiae point of the first fingerprint. 

50 20. The display control method as defined in claim 1 5, comprising: 

extracting a minutiae point of at least the first fingerprint image; and 

checking the first fingerprint image with registration information which has been previously registered, wherein: 

55 the registration information includes the number of times a line segment connecting minutiae points of a 

fingerprint image intersects a fingerprint ridge or a fingerprint valley of the fingerprint image; and 
the first fingerprint image is checked based on: the registration information; and the number of times a 
line segment connecting minutiae points of the first fingerprint image intersects a fingerprint ridge or a 
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fingerprint valley of the first fingerprint image. 

21 . The display control method as defined in any one of claims 16,18,19 and 20, 

wherein the minutiae point includes at least one of a ridge bifurcation and a ridge ending of a fingerprint. 

5 

22. The display control method as defined in any one of claims 15 to 21 , 

wherein a frequency in capturing at least the first fingerprint image is lower than a frequency in capturing the 
second fingerprint image when a fingerprint image is periodically captured. 

10 23. The display control method as defined in any one of claims 15 to 21 , wherein: 

an operating mode is transitioned to a high speed mode for operating at a first frequency when a finger is in 
contact with the detection surface, and transitioned to a low speed mode for operating at a second frequency 
when a finger is not in contact with the detection surface. 

15 

24. The display control method as defined in any one of claims 15 to 23, 

wherein an image scrolled based on the comparison result is generated. 

25. The display control method as defined in any one of claims 13 to 23, 

^0 wherein an image having a pointer moved based on the comparison results is generated. 
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